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(54) Apparatus for recognizing environment 

(57) An apparatus for recognizing an environment 
includes imaging unit (10) for picking up surroundings 
of a vehicle equipped with the apparatus so as to obtain 
a surrounding image, filter processing unit (20) for pro- 
viding filter processing to the surrounding image for 
each predetermined sampling interval so as to obtain a 
process image and edge information, processed infor- 
mation memorizing unit (30) for memorizing the process 
image, image finite differentiating unit (40) for obtaining 



a difference image between the process image and a 
process image before an arbitrary sampling interval, fre- 
quency accumulating unit (50) for accumulating the 
number of moving pixels for each moving direction 
based on the edge information and the difference image 
so as to obtain a cumulative value, and determining unit 
(60) for performing determination of a surrounding en- 
vironment in accordance with the cumulative value of 
the frequency accumulating unit (50). 
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Description 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

[0001] The present invention relates to an apparatus 
for recognizing an environment, which recognizes an 
environment around a vehicle equipped with the appa- 
ratus (hereinafter referred to as an apparatus-equipped 
vehicle) by use of image processing. 

2. Description of the Related Art 

[0002] Japanese Patent Application Laid-Open No. 
2000-259998 describes one of conventional apparatus- 
es for surveying an environment around an apparatus- 
equipped vehicle. The prior art grasps the positional re- 
lationship between the apparatus-equipped vehicle and 
other vehicles running behind the apparatus-equipped 
vehicle by use of an optical flow (velocity vectorthat con- 
nects corresponding points in two images with a time 
interval). Further, the above-mentioned prior art esti- 
mates a white line that distinguishes between a lane for 
the apparatus-equipped vehicle and an adjacent lane 
based on information about the road on which the ap- 
paratus-equipped vehicle has run, the information being 
obtained while driving. Moreover, the prior art deter- 
mines to which of the lane for the apparatus-equipped 
vehicle and the adjacent lane other vehicle, which gen- 
erates the optical flow, belongs. 

SUMMARY OF THE INVENTION 

[0003] However, the aforementioned surveying appa- 
ratus using the optical flow is structured so as to search 
the corresponding points of two continuous images ob- 
tained by imaging means every predetermined time and 
connect the corresponding points, thereby obtaining the 
velocity vector. At the time of detecting the correspond- 
ing points, it is required that correlation between images 
should be calculated or a flow should be calculated by 
an iterative operation using constraint condition about a 
concentration gradient, so that processing procedure 
becomes complicated. Therefore, the calculation 
amount massively increased, causing such a problem 
that a realization of a high-speed moving direction was 
not able to be obtained unless a high-performance and 
expensive CPU was used. 

[0004] The present invention has been made to solve 
the problem of the prior art as mentioned above. It is an 
object of the present invention to provide an apparatus 
for recognizing an environment, which easily recognizes 
an environment around an apparatus-equipped vehicle 
by reducing a calculation amount. 
[0005] The first aspect of the present invention pro- 
vides an apparatus for recognizing an environment, 
comprising: an imaging unit, which is attached to a ve- 



hicle, for picking up surroundings of the vehicle so as to 
obtain a surrounding image; a filter processing unit for 
providing filter processing to the surrounding image for 
each predetermined sampling interval so as to obtain a 

5 process image and an edge information: a processed 
information memorizing unit for memorizing the process 
image; an image finite differentiating unit for obtaining 
a difference image between the process image and a 
process image before an arbitrary sampling interval: a 

10 frequency accumulating unit for accumulating the 
number of moving pixels for each moving direction 
based on the edge information and the difference im- 
age, and for obtaining a cumulative value: and a deter- 
mining unit forperforming a determination of a surround- 

15 jng environment in response to the cumulative value of 
the frequency accumulating unit. 

BRIEF DESCRIPTION OF THE DRAWINGS 

20 [0006] 

Fig. 1 is a block diagram of an apparatus for recog- 
nizing an environment according to the present in- 
vention; 

25 Figs. 2A and 2B are waveform views illustrating the 

relationship between a process period and a control 
period; 

Fig. 3 is a schematic view illustrating process image 
every predetermined time interval; 
30 Figs. 4A and 4B are views illustrating the principle 

of detecting movement of a target object; and 
Figs. 5A to 5C are views explaining a method for 
determining vehicle control and a warning by use of 
determining means 60 and views illustrating an ex- 
35 ample of an image when the front of vehicle is 
picked up. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[0007] In Fig. 1, imaging means 10 is mounted on a 
vehicle : and picks up images around the vehicle such 
as the front, back, etc., so as to obtain the image. For 
example, an electronic camera is used. Filter process- 
ing means 20 provides filtering process to the image 
formed by the imaging means 10 for each predeter- 
mined sampling period and extracts edge information 
such as an edge position and the like in the image. Proc- 
essed information memorizing means 30 memorizes 
the process image subjected to filtering process for each 
predetermined sampling period. Image finite differenti- 
ating means 40 calculates a difference image between 
the process image memorized in the processed infor- 
mation memorizing means 30 and the latest process im- 
age processed by the filter processing means 20. Fre- 
quency accumulating means 50 refers to a pixel value 
of the difference image corresponding to the edge posi- 
tion extracted by the filter processing means 20. Then, 
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the frequency accumulating means 50 accumulates the 
^ number of pixels of an edge for each direction where the 

edge position moves based on the pixel value to which 
reference is made and an edge type (to be described in 
detail later). Determining means 60 determines the 
presence of an object approaching an apparatus- 
equipped vehicle based on an accumulative value of the 
number of pixels of the edge for each velocity direction 
generated by the frequency accumulating means 50. 
Based on the determination, the determining means 60 
outputs a controlling command or a warning signal to a 
vehicle actuator and a commanded value that changes 
or limits a sensing range of a camera mounted on the 
vehicle or radar mounted thereon. The actuator and 
warning means 70 perform necessary control opera- 
tionsin response to the aforementioned controlling com- 
mand and warning signal, and issue a warning. 
[0008] Hereafter the operation of each structural 
means of Fig. 1 will be explained based on Figs. 2A, 2B 
and 3. 

[0009] Each structural means of Fig. 1 operates in ac- 
cordance with either the process (sampling) period (see 
Fig. 2A) or the control period (see Fig. 2B). Namely, the 
imaging means 10, filter processing means 20, imago 
finite differentiating means 40 and frequency accumu- 
lating means 50 operate in accordance with the process 
period, and the processed information memorizing 
means 30 and determining means 60 operate in accord- 
ance with the control period. 

[0010] In Figs. 2A and 2B, it is assumed that time t is 
a control period starting time. The imaging means 10 
forms an image l(t) around the vehicle at time t. Sequen- 
tially, the formed image is subjected to filter processing 
(for example, filter processing with a side control effect 
to be described later) by the filter processing means 20. 
Thereafter, a process image te(t) is memorized in the 
processed information memorizing means 30. 
[001 1 ] Next, the imaging means 1 0 obtains an image 
I (t + At) at time (t + At) for each process period. The 
obtained image I (t + At) is processed by the filter 
processing means 20 such that a process image le (t + 
At) can be obtained. At this time, the filter processing 
means 20 extracts edge information e (x, y, type) of an 
edge position and an edge type in a focused direction. 
[001 2] The edge information e (x, y, type) includes co- 
ordinate information e (x, y) of the edge position and 
edge type information e (lype) (lo be described in detail 
later). In Fig. 3, each rhombus displayed for each time 
(t, t + At, t + 2At ...) shows each process image. The 
process image at time t is one that is memorized in the 
processed information memorizing means 30. 
[0013] Sequentially, the image finite differentiating 
means 40 calculates le (t + At) - le (t) using the process 
image le (t) stored in the processed information memo- 
rizing means 30, thereby obtaining a difference image 
Is (t, At). The difference image Is (t, At) is a difference 

... image between images with sampling interval At for a 

' control period t. 



[0014] The frequency accumulating means 50 refers 
to a pixel p (t. At. x. y) in the difference image Is (t. At) 
corresponding to coordinate information e (x. y) of the 
edge position. The frequency accumulating means 50 
5 determines whether or not the edge has moved based 
on a sign of the pixel and an edge type and detects the 
moving direction. The frequency accumulating means 
50 increases a cumulative value of velocity v (At) by one 
in accordance with the moving direction when the fo- 
10 cused edge position moves. The aforementioned cumu- 
lative operation is provided to all edge positions. 
[0015] After that, at time t + 2At after two process pe- 
riods, an image I (t + 2At) is obtained. The obtained im- 
age I (t + 2At) is processed by the filter processing 
? 5 means 20 : whereby obtaining a process image le (t + 
2At). At this time, the filterprocessing means 20 extracts 
edge information e (x, y, lype) about the edge position 
and the edge type of the focused direction. 
[0016] Sequentially, the image finite differentiating 
20 means 40 calculates le (t + 2At) - le (t) using the image 
le (t) stored in the processed information memorizing 
means 30, so that a difference image Is (t, 2At) can be 
obtained. 

[0017] The frequency accumulating means 50 refers 
25 to a pixel p (t, 2At, x : y) in the difference image Is (t. 2At) 
corresponding to coordinate information e (x, y) of the 
edge position. The frequency accumulating means 50 
determines whether or not the edge has moved based 
on a sign of the pixel and an edge type thereof and de- 
30 tects the moving direction. The frequency accumulating 
means 50 increases a cumulative value of velocity v 
(2At) by one in accordance with the moving direction 
when the focused edge position moves. The aforemen- 
tioned cumulative operation is provided to all edge po- 
35 sitions. 

[0018] In Figs. 2A and 2B, since the control period is 
5At, processing, which includes the image pickup to the 
frequency accumulation, is repeated until t + 4At after 
four process periods, and a pixel velocity distribution 

40 can be obtained in the form of, e.g. , a histogram for each 
moving direction (refer to Figs. 5B and 5C). 
[0019] The determining means 60 performs determi- 
nation based on the velocity distribution obtained by the 
above iterative process at the end of the control period, 

45 which begins at time t. Under the determination, the de- 
termining means 60 outputs a control signal or a warning 
signal as required (lo be described in detail later). 
[0020] The apparatus of Fig. 1 executes the afore- 
mentioned processing repeatedly for each control peri- 

50 od as shown in Figs. 2A and 2B. In addition, the process 
period is fixed in accordance with a velocity resolution 
and the control period. 

[0021 ] Hereafter, the principle of movement detection 
will be explained based on Figs. 4A and 4B. In Figs. 4A 
55 and 4B, to simplify the explanation, an image is one- 
dimensionally set, a vertical axis (y-axis) is a pixel value, 
and a horizontal axis (x-axis) is a pixel position. Further, 
a reference numeral 400 denotes an image I (t) that 
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changes stepwise. 

[0022] In Fig. 4A. the image l(t) 400 moves to a right 
image I (t + At) 410.. which is shown by a wave line after 
time At. In Fig. 4B. the image l(t) 400 moves to a left 
image i (t + At) 420 ; which is shown by a wave line after 
time At. Hereafter the principle of movement of I (t) 400 
will be described. 

[0023] First, when original images I (t) 400. 410, 420 
are subjected to filtering that has a side control eflect. 
process images le (t) 401 , le (t + At) 411 and le (t + At) 
421 are obtained, respectively. Additionally, the side 
control effect is one that controls a portion excepting a 
necessary focused point (e.g.. edge) to emphasize only 
the focused point. As a filter with such an effect, for ex- 
ample, there is a filter in which a Gaussian filter and a 
Laplacian filter are combined. 

[0024] Second, coordinates of zero cross points 412 
and 422 where the sign of pixel value changes from a 
positive to a negative or from a negative to a positive 
are obtained from the latest process images le (t + At) 
411 and le (t + At) 421 , respectively. The positional co- 
ordinate of the zero cross point corresponds to that of 
the edge. Edge type information e (type) refers to one 
that has a pattern where the zero cross point changes 
from a positive to a negative or from a negative to a pos- 
itive. Namely, edge information e (x, type) is constituted 
by an edge position coordinate x and an index type that 
indicates a change type of the edge, which is deter- 
mined by whether the pixel value changes from the pos- 
itive to the negative or from the negative to the positive 
at the zero cross point. For example, at the zero cross 
points 412 and 422 in Figs.4A and 4B, the pixel value 
of each of the zero cross points changes from the pos- 
itive to the negative to direct from the small pixel position 
to the large pixel position. It is assumed that the type of 
this case is set to "0." Conversely, the type when the 
pixel value changes from the negative to the positive is 
set to "1." In this way, any index may be used as the 
edge type information e (type) if the index indicates the 
edge change type uniquely. In Figs. 4A and 4B, the type, 
which changes from the positive to the negative to direct 
from the small pixel position to the large pixel position, 
is defined as "0" and the type, which changes from the 
negative to the positive, is defined as "1 ." 
[0025] As described above, the pixel position of edge 
is obtained using the filter with the side control effect in 
the filler processing, and edge information, which is con- 
stituted by the change type of the pixel value in the di- 
rection where attention is paid to the edge, is extracted. 
Thus, regarding an unnecessary portion, namely, a por- 
tion where substantially the fixed pixel value is provided 
and the change in movement cannot be detected, such 
a portion is excluded from processing in advance. 
Therefore, an unnecessary calculation amount can be 
reduced. 

[0026] Moreover, edge information is expressed by 
the pixel position of edge and the change type of pixel 
value, thereby making it possible to simplify processing 



and to reduce the calculation amount. 
[0027] Third, image finite differentiating process le (t 
+ At) - le (t) is carried out, and then difference images 
Is (t. At) 413 and Is (t. At) 423 can be obtained. 

5 [0028] Here, reference is made to pixel p (t, At. x) in 
the difference image Is (t, At) based on edge position 
information e (x) of edge information e (x. type) previ- 
ously obtained. A sign of the pixel is checked. At this 
time, the edge type is "0." Thus, if the sign of p (t. At, x) 

10 is positive, the corresponding edge moves right. If the 
sign of p (t ; At. x) is negative, the corresponding edge 
moves left. The above-mentioned movement of edge is 
determined uniquely. 

[0029] If the edge type is "1" and the sign of p (t At, 
75 x) is positive, the corresponding edge moves left. If the 
sign of p (t, At, x) is negative, the corresponding edge 
moves right. The above movement of edge is deter- 
mined uniquely. 

[0030] As described above, it is possible to easily de- 
20 tect the moving direction of the focused pixel based on 
the sign of the difference image between the images 
processed by the filter with the side control effect and 
the edge type. Namely, by checking only the sign of the 
pixel value of the difference image corresponding to the 
25 focused pixel position of process image, it is possible to 
know which direction the focused pixel moves. Accord- 
ingly, the calculation amount of movement detection can 
be largely reduced. 

[0031] In addition, detection, which matches the ve- 

30 locity, can be carried out in accordance with the image 
interval to be subjected to difference processing. As 
shown in Fig. 3, in the case of an object that moves at 
high speed, an image changes for a short time, so that 
a detection result appears in difference processing for 

35 each sampling interval (At). The velocity of the change 
in the image becomes lower with the reduction in veloc- 
ity, such that a remarkable effect appears in large differ- 
ence processing with the image intervals 2At to 4At. A 
one-to-one correspondence is established between 

^0 each image interval and a velocity field (velocity vector) 
that is determined by a sampling rate in the case of cal- 
culating while changing the image interval for the differ- 
ence processing. Therefore, the image interval is 
changed to At, 2At, 3At, 4At. sequentially in one control 

45 period and a difference image is obtained with four types 
of image intervals, whereby obtaining a cumulative val- 
ue of the number of pixels that moves for each moving 
velocity range. 

[0032] Figs. 5A to 5C are views explaining a method 
50 for determining vehicle control and a warning by use of 
determining means 60 and views illustrating an example 
of an image when the front of vehicle is picked up. Here- 
after, with reference to Figs. 5A to 5C ; an explanation 
will be given of the system that performs the vehicle con- 
55 trol and warning based on a cumulative frequency of im- 
ages for each moving direction and each velocity range 
that is obtained on the basis of the aforementioned de- 
tection principle. 
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[0033] Generally, in the velocity distribution in the 
front image obtained from the vehicle in driving, there 
are many pixels in the direction flowing from a disap- 
pearing point (for example, a point where both side lines 
of the road cross each other at the front in the driving 
direction). Namely, regarding the left side of the image 
there are many pixels that move to the left direction, and 
regarding the right side of the image, there are many 
pixels that move to the right direction. Under the afore- 
mentioned circumstances, in the case where there is a 
vehicle that cuts into the front of the apparatus-equipped 
vehicle from the right lane, the velocity distribution in the 
window in the right changes and the number of pixels 
that moves to the left increases. Then, the image is di- 
vided into the right and left (it is divided into the right and 
left at a central wave line of Fig. 5A). In connection with 
a left window (see Fig. 5B). the velocity distribution of 
pixels that move to the right can be obtained. In connec- 
tion with a right window (see Fig. 5C) : the velocity dis- 
tribution of pixels that move to the left can be obtained. 
A comparison between the cumulative frequency of 
these velocity distributions and a predetermined value 
set in advance is performed. If the cumulative frequency 
is larger than the predetermined value, it is determined 
that there is a tendency for an object to approach the 
apparatus-equipped vehicle, and then a warning can be 
issued or a brake and a steering actuator can be con- 
trolled. In Figs. 5A and 5B : a level A or more indicates 
a warning range and a level B or more indicates a con- 
trolling range. 

[0034] In the cumulative frequency of the number of 
pixels that is classified for each moving direction of mov- 
able pixels and for each moving velocity range, the pos- 
sibility of the existence of object with focused moving 
direction and velocity and the degree of danger to the 
apparatus-equipped vehicle are reflected. Hence, a cal- 
culation for specifying a focused object and a calculation 
for the degree of danger become unnecessary by 
checking only a predetermined accumulative frequency 
for each display. Accordingly, a load of calculations can 
be largely reduced. 

[0035] It is possible to determine whether or not the 
object approaches the apparatus-equipped vehicle 
based on the cumulative frequency obtained by the fre- 
quency accumulating means 50. Moreover, it is also 
possible to decide control amounts of brake and steer- 
ing and the level of warning in accordance with the ve- 
locity of the object determined as approaching. For ex- 
ample, concerning the warning, it is possible to adopt 
such a structure that issues a preliminary warning when 
an approaching velocity is lower than a predetermined 
velocity and that gives an emergency warning when the 
approaching velocity is higher than the predetermined 
velocity. Alternatively, it is possible to use such a struc- 
ture that changes the level of the warning sound in ac- 
cordance with the velocity. Concerning the brake, it is 
possible to use such a structure that changes the degree 
of braking in accordance with the degree of emergency 



corresponding to the approaching velocity of the object. 
Concerning the steering, it is possible to use such a 
structure that changes magnitude of a steering angle 
and a steering velocity in accordance with the degree of 
3 emergency to avoid the approaching object. 

[0036] Detection window areas (right and left alloca- 
tions) obtained by dividing the display in Fig. 5A. a warn- 
ing threshold value A. a controlling threshold value B. a 
focused direction of the display, etc. are controlled by 
'C use of steering angle information and yawing angle in- 
formation. Therefore, it is possible to change the setting 
for each straightaway and for each curve in the road. 
[0037] In the case where a camera for image pickup 
and radar for distance detection are mounted on the ve- 
1$ hide, it is possible to structure the determining means 
60 such that the searching range of the vehicle-mounted 
camera and radar and the processing range thereof are 
changed based on the aforementioned edge informa- 
tion and cumulative value. The aforementioned struc- 
?o iu, e makes it possible to specify an area where a mov- 
able object with a predetermined movement vector ex- 
ists in the image based on the edge information and the 
cumulative frequency. Accordingly, the searching range 
of the vehicle-mounted camera and radar and the 
25 processing range thereof can be limited efficiently. 

[0038] According to the first aspect of the present in- 
vention, the number of pixels of the movement portion 
is sequentially accumulated based on the pixel value of 
the difference image for each predetermined sampling 
30 interval. Thus, it is possible to easily obtain the velocity 
distribution for each predetermined moving velocity 
range. Processing is simplified, so that an environment 
around the apparatus-equipped vehicle can be recog- 
nized with a small amount of calculations. 
35 [0039] According to the second aspect of the present 
invention, the pixel position of edge is obtained using 
the filter with a side control effect in the filter processing, 
and edge information, which is constituted by the 
change type of the pixel value in the direction where at- 
■J0 tention is paid to the edge, is extracted. Hence, regard- 
ing an unnecessary portion, that is, a portion where sub- 
stantially the fixed pixel value is provided and the 
change in movement cannot be detected, such a portion 
is excluded from processing in advance.. Therefore, an 
•*5 unnecessary calculation amount can be reduced. 

[0040] According to the third aspect of the present in- 
vention, edge information is expressed by the pixel po- 
sition of the edge and the change type of the pixel value, 
thereby making it possible to simplify processing and to 
50 reduce the calculation amount. 

[0041] According to the fourth aspect of the present 
invention, by checking only the sign of the pixel value of 
the difference image corresponding to the focused pixel 
position of process image, it is possible to know which 
55 direction the focused pixel moves. Accordingly, the cal- 
culation amount of movement detection can be largely 
reduced. 

[0042] According to the fifth aspect of the present in- 
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vention, the possibility of existence of object with fo- 
cused moving direction and velocity and the degree of 
danger to the apparatus-equipped vehicle are reflected 
in the cumulative frequency of the number of pixels that 
is classified for each moving direction of movable pixels 
and for each moving velocity range. Thus, by checking 
only a predetermined accumulative frequency for each 
display, a calculation for specifying a focused object and 
a calculation for the degree of danger become unnec- 
essary. Therefore, a load of calculations can be largely 
reduced. 

[0043] According to the sixth aspect of the present in- 
vention, it is possible to specify an area where a mova- 
ble object with a predetermined movement vector exists 
in the image based on the edge information and cumu- 
lative frequency. Accordingly, the searching range of the 
vehicle-mounted camera and radar and the processing 
range thereof can be limited efficiently. 
[0044] The present disclosure relates lo subject mat- 
ters contained in Japanese Patent Application No. 
2001 -236595, filed on August 3, 2001 , the disclosure of 
which is expressly incorporated herein by reference in 
its entirety. 

[0045] While the preferred embodiments of the 
present invention have been described using specific 
terms, such description is for illustrative purposes. It is 
to be understood that the invention is not limited to the 
preferred embodiments or constructions. To the contra- 
ry, the invention is intended to cover various modifica- 
tions and equivalent arrangements. In addition, while 
the various elements of the preferred embodiments are 
shown in various combinations and configurations, 
which are exemplary, other combinations and configu- 
rations, including more, less or only a single element, 
are also within the spirit and scope of the invention as 
defined in the following claims. 

Claims 

1 . An apparatus for recognizing an environment, com- 
prising: 

an imaging unit (10), which is attached to a ve- 
hicle, for picking up surroundings of the vehicle 
so as to obtain a surrounding image: 
a filler processing unit (20) for providing a filler 
processing to the surrounding image for each 
predetermined sampling interval so as to obtain 
a process image and an edge information; 
a processed information memorizing unit (30) 
for memorizing the process image; 
an image finite differentiating unit (40) for ob- 
taining a difference image between the process 
image and a process image before an arbitrary 
sampling interval; 

a frequency accumulating unit (50) for accumu- 
lating the number of moving pixels for each 



moving direction based on the edge information 
and the difference image so as to obtain a cu- 
mulative value: and 

a determining unit (60) for performing a deter- 
5 mination o\ a surrounding environment in ac- 

cordance with the cumulative value of the fre- 
quency accumulating unit (50). 

2. The apparatus according to claim 1 . 

10 wherein the filter processing unit (20) pro- 

vides filter processing with a side control effect to 
the surrounding image, and detects the edge infor- 
mation constituted of a pixel position of an edge and 
a change type of a pixel value at the pixel position. 

75 

3. The apparatus according to claim 2, 

wherein the filter processing unit (20) pro- 
vides the filter processing with a side conirol effect 
to Ihe surrounding image so as lo obtain Ihe proc- 

20 ess image, thereafter a pixel position where a sign 

of a pixel value of an adjacent pixel in an arbitrary 
direction is reversed is used as a pixel position of 
the edge from the process image, and 

wherein the filter processing unit (20) differ- 

25 entiates between a case where the sign is reversed 

from a positive to a negative and a case where the 
sign is reversed from a negative to a positive so as 
to form the change type of the pixel value. 

30 4. The apparatus according to claims 2 or 3, 

wherein the frequency accumulating unit (50) 
detects a moving direction of the pixel position by 
the sign of the pixel value of the difference image 
at the pixel position of the edge information and the 

35 change type of the pixel value, and 

wherein the frequency accumulating unit (50) 
calculates a cumulative value of the number of pix- 
els having an arbitrary moving direction for each 
moving velocity range. 

40 

5. The apparatus according to claims 1 or 4, 

wherein the determining unit (60) determines 
whether or not an object approaches the vehicle 
based on the cumulative value obtained by the fre- 
45 quency accumulating unit (50) : and 

wherein at least one of control amounts of a 
brake and steering and a warning level is decided 
in accordance with the velocity of the object deter- 
mined as approaching. 

50 

6. The apparatus according to claim 4, 

wherein the determining unit (60) changes a 
searching range and a processing range of at least 
one of a vehicle-mounted camera and radar based 
55 on the edge information and the cumulative value. 

7. A method for recognizing an environment, compris- 
ing: 
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picking up surroundings of the vehicle so as to 
obtain a surrounding image; 
providing a filter processing to the surrounding 
image for each predetermined sampling inter- 
val so as to obtain a process image and an edge 5 
information; 

memorizing the process image: 
obtaining a difference image between the proc- 
ess image and a process image before an ar- 
bitrary sampling interval; io 
accumulating the number of moving pixels for 
each moving direction based on the edge infor- 
mation and the difference image so as to obtain 
a cumulative value; and 

performing a determination of a surrounding 75 
environment in accordance with the cumulative 
value. 
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FIG.4A 
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FIG.5A 
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